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IMAGE SENSOR ARRAY WITH SUBSTITUTIONAL CIRCUIT 

DISTRIBUTION 

FIELD OF THE INVENTION 

5 The invention relates generally to the field of image sensors having 

an array of active imaging pixels, and in particular to interspersing substitutional 
pixels that are substantially different in design firom the imaging pixels in the 
array of pixels for providing information or functions and the like for improving 
performance. 

10 

BACKGROUND OF THE INVENTION 

Typically, image sensors are manufactured within a certain 
tolerance specification in which a few pixels have somewhat undesirable 
characteristics. These pixels are commonly referred to as "defective pixels" 

1 5 because, although they are operational, they do not have the same desired 

performance characteristics as the other pixels. Given a sufficiently low density, 
these defective pixels do not substantially degrade the quality of a captured image 
because they are typically replaced by calculated substitute values, which closely 
approximate the value if the pixel was not defective. 

20 One such technique is to replace the defective pixel value with the 

average of a predetermined number of nearest neighbor values. This 
predetermined number of nearest neighbor could be two immediate adjacent 
pixels or four immediate adjacent pixels. 

It is also instructive to note that image sensors are also formed 

25 fi*om an array of identical cells (typically four immediate adjacent pixels) so that 
the imaging characteristics of the sensor are substantially uniform across the array. 
Design of these cells are often a trade-off or compromise of several competing 
imaging performance parameters, such as read-out rate, photosensitivity, and 
photo-response non-uniformity. 

30 Consequently, a technique or method is needed to provide 

improvements in a specific imaging performance parameter without substantial 
degradation of other aspects. One such improvement is to use the knowledge that 
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defective pixels do not substantially degrade image quality for enhancing other 
imaging parameters. 

SUMMARY OF THE INVENTION 

5 The present invention is directed to overcoming one or more of the 

problems set forth above. Briefly summarized, according to one aspect of the 
present invention, the invention resides in an image sensor including (a) a 
plurality of photosensitive sites which convert incident light into a charge for 
forming a bounded array of active imaging pixels; (b) one or more substitutional 

10 pixel sites arranged in predetermined locations and interspersed amongst the 

boundary of the array of active imaging pixels; wherein the substitutional pixels 
are of a different design from the active imaging pixels which provides data, 
information or function different from the active pixels for improving 
performance, operation, manufacture, and/or assembly of the image sensor. 

15 These and other aspects, objects, features and advantages of the 

present invention will be more clearly understood and appreciated from a review 
of the following detailed description of the preferred embodiments and appended 
claims, and by reference to the accompanying drawings. 

20 Advantageous Effect Of The Invention 

The present invention has the following advantage of improving 
specific aspects of the performance, operation, manufacture, and/or assembly of 
the image sensor without degrading other performance aspects of all pixels. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a top view of the image sensor of the present invention; 
Fig. 2 is a camera for implementing a preferred commercial 
embodiment for the image sensor of Fig. 1 ; and 

Fig. 3 is an illustration of a technique for computing an average of 
30 nearest neighbors that may be used as a pixel value for the substitutional pixels. 
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DET AILED DESCRIPTION OF THE INVENTION 

Before discussing the present invention, it is instructive to have a 
common understanding of image sensor terminology, such as "active" which is 
used or mated with other terms for describing entirely different qualities. In this 
5 regard, image sensors may be formed using a CCD (charge coupled device) 
technology or using a CMOS (complementary metal oxide semiconductor) 
technology. Image sensors made with CMOS technology use an "active element" 
such as a transistor in each pixel. This is typically referred to as an "active 
CMOS" image sensor. In active CMOS imagers, one or more active elements in 

10 the pixel converts the signal charge into a voltage, thereby providing a voltage 
which is representative of the light intensity upon that pixel. Regardless of the 
technology, the array of pixels that actually captures the incident light for 
converting it to charge is referred to as "active imaging pixels." It is noted that 
image sensors also contains "dark reference pixels" that are typically disposed in a 

15 spaced-apart relationship from the active imaging pixels. These pixels are used 
for calibration purposes, and are mentioned herein so that active imaging pixels 
are clearly distinguished therefrom. 

Now referring to Fig. 1 , there is shown a top view of an image 
sensor 10 of the present invention. In this regard, a plurality of pixels 20 is 

20 arranged in an array of N by M pixels for forming a bounded active imaging array 
or area, where N and M are any predetermined number of pixels such as, for 
example, 200 to 4,000. Each pixel 20 captures incident light that is converted into 
a charge representative of the intensity of the incident light. For clarity, it is noted 
that these pixels collectively form the active imaging pixels. In such devices, the 

25 active imaging pixels 20 are energized for operation via a plurality of supply 

buses 30 that are energized to a predetermined voltage level as is well known in 
the art. 

Still referring to Fig. 1 , a predetermined number of the active 
imaging pixels 20 are replaced by pixels 40 that are used for an entirely or 
30 substantially different purpose than the active imaging pixels. These pixels 40 are 
referred to hereinafter as substitutional pixels. These substitutional pixels 40 are 
used to provide data, information and/or ftinction different from the active pixels 
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20 for improving performance, operation, manufacture, and/or assembly of the 
image sensor 10. For example, the substitutional pixels 40 may be used as 
amplifier circuits or buffer circuits for improving distribution of current or voltage 
across the array of active imaging pixels. Such amplifier circuits and buffer 
5 circuits are well known in the art and are not described in detail herein. Such 

amplifier circuits or buffer circuits may also be used for improving signal integrity 
within or across the array of pixels. For example, in large arrays, the voltage 
provided by the active elements in the pixel must be supplied over a long metal 
output line that has some resistance and capacitance. For large arrays, the 

10 resistance and capacitance of the metal line may increase the time required to 
establish that voltage along the entire line. In such a case, either the operating 
speed of the imager is compromised, or a non-uniformity in photo response may 
occur as a result of the capacitance and resistance of the long metal line. In this 
case, a buffer amplifier may be used in a substitutional pixel to decrease the time 

15 required to establish the voltage along the entire line. 

In addition, these substitutional pixels may be used for determining 
altemate image parameters including altemate color, infi'ared constituents or other 
photo-metric parameters. For example, a filter that allows only infirared light 
through to the photosensitive region of the pixel may be placed over a pixel so 

20 that a sampling of the infirared component of the incident radiation may be 

obtained. In a CCD image sensor, particularly those for which the pixel array is 
formed in a well of conductivity type opposite the substrate, degradation of the 
maximum charge handling capacity of some pixels may be degraded due the 
inability to maintain a uniform ground potential within the well due to its 

25 resistivity. The substitutional pixel sites may be used to provide a ground contact 
within the image sensor to maintain a more uniform ground potential in the well. 
The substitutional pixels may also be used as fiducial elements, which can be used 
for a mechanism for aligning the image sensor. Finally, such substitutional pixels 
may provide dark reference levels for image processing. Dark reference signals 

30 are taken with the pixel covered in some manner so that it is not exposed to light. 
The value fi*om this "dark" exposure is then used for calibration dxiring image 
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processing. This dark reference signal from the substitutional pixels can be in lieu 
of or in additional to the usual dark reference pixel values. 

Referring to Fig. 2, there is shown a digital camera 50 for 
implementing the image sensor 10 of the present invention in a typical 
5 conmiercial embodiment to which an ordinary consumer is accustomed. The 
camera 50 also includes a mechanism, preferably an algorithm, for correcting the 
image created by the plurality of active imaging pixels by providing a signal level 
for an image site at a substitutional pixel location. The processor 60 of the camera 
50 may compute this correction value by well-known programming techniques. 

10 This algorithm, for example, could be by computing the average of a 

predetermined number of nearest neighbors. Referring to Fig. 3, the nearest 
neighbors could be the two immediately adjacent nearest neighbors (A and B) of 
the pixel of interest (X) or the four immediately adjacent nearest neighbors (C, D, 
E and F) of the pixel of interest (Y). 

15 For a color image sensor, color filters are typically arranged on top 

of the active pixels in an altemating RGBG pattern, known as the Bayer pattern, 
where R indicates a red filter, B a blue filter, and G a green filter, as shown in 
Fig. 4a. In this case, the correction value could use the closest neighboring color 
pixels. Referring to Fig. 4b, the nearest neighbors could be A and B for a green 

20 pixel of interest X or neighbors C, D, E, F for green pixel of interest Y. For a blue 
pixel of interest Z, the nearest neighbors could be G, H, I, J. A similar calculation 
could be done for red pixels with the appropriate coordinate transformation. One 
will note, that other more elaborate correction algorithms could also be used. 

The invention has been described with reference to a preferred 

25 embodiment. However, it will be appreciated that variations and modifications 
can be effected by a person of ordinary skill in the art without departing from the 
scope of the invention. 
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